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f.TSTTNG OF THE CLAIMS 

Claims 2, 4-11, 14-20. 22-24, 26-32, 36, and 39-40 are pending. No claims 
are canceled. No claims are added. Please amend claims 4. U, and 28. The 
following listing of claims replaces all prior versions, and listings of claims in the 
application. 

Testing of Claims: 

1. (Canceled). 

2. (Previously presented) A mettiod as recited in claim 5+, wherein the 
operation of estimating head motion further comprises: 

calculating an estimation objective function comprising a set of terms to 
estimate: (a) each of the set of physical fkce parameters, (b) a first head pose 
transform corresponding to the first image, and (c) a second head pose transform 
corresponding to the second image. 



(Canceled). 



4, (Currently amended) A method as recited in claim 5?: 
wherein the particular face parameter corresponds to the nose tip; and 
wherein the predetermined minimum value is zero (0) and the 

predetermined maximum value is a seaseaaMe value based on absolute values of 

other of the locations. 

Pase 3 of 17 MS1-6S4US.M02 



PA(^S/19*RCVDAT10/12I20M6:14:25PM [Eastern DayOghtriine]'SVR:USPTO-^^^^^ 



OCT 12 2004 15=30 FR LEE - HfiYES PLL 509 323 8979 TO 17038729306 P. 06/19 



Appl. No. 09/731,481 

Response to August 25. 2004 Office action 



5. (Previously presented) A method to estimate head motion between 
two images of a face, the method comprising operations of: 

identifying locations of a pluraUty of distinct facial features in the two 
images, the locations corresponding to a number of unknowns detennined upon 
estimation of head motion, the number of unknowns being determined by a 

number of equations; 

converting the identified locations into a set of physical fece parameters 
based on the symmetry of the distinct facial features, the set of physical face 
parameters reducing the number of unknowns as compared to the number of 
equations used to determfaie the unknowns; 

adding an inequality constraint on a particular face parameter of the 
physical face parameters, such that the particular face parameter is constrained 
withm a predetermined minimum and maxhnum value; 

converting the inequality constraint to an equality constraint using a penalty 

function; and 

estimating head motion from identified points in the two images, the 
identified points being based on the set of physical face parameters. 
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6. (Previously presented) A method to estimate head motion between 
two images of a face, the method comprising operations of: 

identifying locations of a pluraUty of distinct facial features in the two 
images, the locations corresponding to a number of unknowns determined upon 
estimation of head motion, the number of unknowns being determined by a 

number of equations; 

converting the identified locations into a set of physical face parameters 
based on the symmetry of the distinct fecial features, the set of physical face 
parameters reducing the number of unknowns as compared to the number of 
equations used to determine the unknowns; and 

estimating head motion from identified points in the two images, the 
identified points being based on the set of physical face parameters; and 

wherein the operation of estimating head motion comprise operations of: 

calculating an estimation objective fimction to determine an initial 
estimate of head rotation, the estimation objective fimction comprising a set of 
terms to estimate: (a) each of the set of physical fece parameters, (b) a first head 
pose transform corresponding to the first image, and (c) a second head pose 
transform corresponding to the second image; 

placing an inequality consUraint on a particular face parameter of the 
set of physical face parameters, such that the particular face parameter is 
constrained within a predetermined minimum and maximum value; 

converting the inequality constraint to an equality constraint using a 

penalty fimction; and 

adding the equality constraint to the initial estimate [estimation system]. 
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7. (Previously presented) A method as recited in claim 54r, wherein the 
identified locations correspond to the eye comers, mouth comers and nose tip. 



8. (Original) A method as recited in claim 2, wherein in the operation of 
estimating the head motion further comprises an operation of multiplying each 
term of the estimation objective function by a weighted contribution factor based 

oni 



; the confidence of data corresponding to the estimation objective fimction. 



9. (Original) A method as recited in claim 5, wherein in the operation of 
providing further comprises operations of: 

multiplying each term of the estimation objective function and the equality 
constraint by a weighted contribution factor based on the confidence of data 
corresponding to the estimation objective function. 

10. (Previously presented) A method as recited in claim S-t, wherem the 
identifying comprises accepting input from a human user. 

11. (Currently amended) A computer-readable medium storing 
computer-executable instructions that, when executed on a computer, are 
configured to perform operations of the method of claim 54-. 

12. (Canceled). 

13. (Canceled). 
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14. (Previously presented) One or more computer-readable media 
containing computer-program instructions executable by a processor to estimate 
motion between two images, the computer-program instructions comprising 
instructions for; 

determining locations of a plurality of distinct features in the two images; 
converting the identified locations into a set of parameters based on the 
symmetry of the distinct features; and 

estimating motion between the two images based on the set of physical face 

parameters by: 

(1) calculating an estimation objective function comprising a set of 
terms to estimate: (a) each of the parameters, (b) a first transform corresponding to 
the first image, and (c) a second transform cSorresponding to the second image; and 

(2) multiplying each term of the estimation objective function by a 
weighted contribution fector based on die confidence of data corresponding to the 

estimation objective fimction. 

15. (Previously presented) One or more computer-readable media as 
recited in claim 1445, after converting and before estimating, fiirther comprising: 

adding an inequality constraint on a particular parameter of tiie parameters, 
such that tiie particular parameter is constrained within a predetermmed minimum 
and maximum value. 
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16. (Original) One or more computer-readable media as recited in claim 



15: 



wherein the predetermined minimum value and the predetermined 
maximum value are based on absolute values of other of the locations. 

17. (Original) One or more computer-readable media as recited in claim 
15, further comprising converting the inequaUty constraint to an equality 
constraint using a penalty function. 

18. (Previously presented) One or more computer-readable media as 
recited in claim 1445, wherein the estimation objective function is used to 
determine an initial estimate of image rotation, wherein tiie first transform is a first 
pose transform corresponding to the first image, and wherein the second transform 
is a second pose transform corresponding to the second image, and wherein 
estimating further comprises: 

placing an inequality constraint on a particular parameter of the parameters, 
such that the particular parameter is constrained within a predetermined minimum 
and maximum value; 

converting the inequality constraint to an equality constraint using a penalty 

function; and 

adding the equality constraint to the initial estimate. 
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19. (Previously presented) One or more computer-readable media as 
recited in claim 18, wherein multiplying further comprises multiplying the 
equality constraint by a weighted contribution factor based on the confidence of 
data corresponding to the estimation objective function. 

20. (Previously presented) One or more computer-readable media as 
recited in claim 1444, wherein the determining comprises accepting input from a 
human user. 

21. (Canceled). 

22. (Previously presented) A method as recited in claim 26^4-, wherein 
the identified locations correspond to the eye comers, mouth comers and nose tip. 

23. (Previously presented) A method as recited in claim 26Si, wherein 
the identifying comprises accepting input from a human user. 

24. (Previously presented) A method as recited in claim 2634-, further 
comprising multiplying the refined head motion estimate by a confidence factor 
that indicates that each of the identified locations was identified with a same level 
of accuracy. 

25. (Canceled). 
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26. (Previously presented) A method to estimate head motion between 
two images of a face, the method comprising: 

identifying locations of a plurality of distinct facial features in the two 
images, the locations corresponding to a number of unknowns determined upon 
estimation of head motion, the number of unknowns being determined by a 

number of equations; 

converting the locations into set of physical face parameters based on the 
symmetry of the identified distinct facial features, the set of physical face 
parameters reducing the number of unknowns as compared to the number of 
equations used to determine the unknowns; 

determining an initial estimation of head motion between the two images 
using the set of physical face parameters as follows: 

(1) calculating an estimation objective fiinction comprising a number 
of terms to estimate each of: (a) the set of coordinates, (b) a first head pose 
transform corresponding to the first image, and (c) a second head pose liansform 
corresponding to the second image; and 

(2) multiplying each temi of the estimation objective function by a 
weighted contribution factor based on the confidence of data corresponding to the 
estimation objective function; and 

refining the initial estimation of head motion by incorporating the initial 
estimation into a feature matching algorithm. 



Page 10 of 17 MS1-684USJV102 

PA(X12I19'RCVDAT 1(111212004 6:14:25 PM [Eastern Daylight Tline]'SVR:USPTO{FX^^^^ 



OCT 12 2004 15:31 FR LEE - HftYES PLL 509 323 8979 TO 1703872930S P. 13/19 

Appl. No. 09/731,481 

Response to August 25. 2004 Office acUon 

27. (Previously presented) A method as recited in claim after the 
converting and before the determining, further comprising: 

adding an inequality constraint on a particular parameter of the physical 
face parameters, such that the parameter is bonstrained within a predetermined 
minimum and maximum value. 

28. (Currently amended) A method as recited in claim 27: 
wherein the particular parameter corresponds to the nose tip; and 
wherein the predetermined minimum value is zero (0) and the 

predetermined maximum value is a feasesable value based on absolute values of 
other of the locations. 

29. (Original) A method as recited in claim 27, further comprising 
converting the inequality constraint to an equality constraint using a penalty 
function. 

30. (Previously presented) A method as recited in claim 2624-, wherein 
the determining further comprises: 

adding an inequality constraint on a particular parameter of the physical 
fece parameters, such that the particular parameter is constrained within a 
predetermined minimum and maximum value; 

converting the mequality constraint to an equality constraint using a penalty 

fiinction; and 

adding the equality constraint to the initial estimate. 
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31. (Previously presented) A method as recited in claim 30, wherein in 
the operation of determining fiirther comprises operations of multiplying the 
equality constraint by a weighted contribution factor based on the confidence of 
data corresponding to the estimation objective fimction. 

32. (Previously presented) A computer-readable medium storing 
computer-executable instructions that, when executed on a computer, perform the 
method of claim 26S4-. 

33. (Canceled). 

34. (Canceled). 

35. (Canceled). 

36. (Previously presented) A computing device to estimate motion 
between two images, the computing device comprising: 

a processor; and 

a memory coupled to the processcff, the memory comprising computer- 
program instructions executable by the processor for 

identifying locations of a plurality of distinct features in the two 
images, the locations corresponding to symmetrical features shared between the 
two images, the locations corresponding to a number of unknowns determined 
upon estimation of motion between the two images; 
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converting the locations into a set of parameters based on the 
symmetiy of the identified distinct features, the parameters reducing the number of 
unknowns as compared to a number of equations used to determine the unknowns; 

estimating motion between the two images using the parameters by: 

(1) calculating an estimation objective function comprising a number 
of terms to estimate each of: (a) the parameters, (b) a first image pose transform 
corresponding to the first image, and (c) a second image pose transform 

corresponding to the second image; 

(2) multiplying each term of the estimation objective fimction by a 
weighted contribution factor based on the confidence of that corresponding data; 

(3) providing an initial estimate of image rotation by estimation of 
each of the parameters, a first image pose transform corresponding to the first 
image, and a second image pose transform corresponding to the second image; 

(4) adding an inequality constraint on a particular parameter of the 
parameters, such that the particular parameter is constrained within a 
predetermined minimum and maximum value; 

(5) converting the inequality constraint to an equality constraint 

using a penalty ftmction; and 

(6) adding the equality constraint to the initial estimate. 

37. (Canceled). 

38. (Canceled). 



Page 13 of 17 MS1-684US.M02 

PAGE 15119 ' RCVD AT 1011212004 6:14:25 PM [Eastern Daylight Time] * SVR:USPT0-EFXRF-1I4 ' DNiS:g729306 * CSD:S09 323 8979 * DURATION ([nnKS):0440 



OCT 12 2004 15.: 32 FR LEE - HfiYES PLL 509 323 8979 TO 1703872930S P. 16/19 

Appl. No. 09/731,481 

Response to August 25, 2004 Office action 

39. (Previously presented) A method to estimate motion between two 

images, the method comprising: 

identifying locations of a plurality of distinct features in the two images, the 
locations corresponding to symmetrical features shared between the two images, 
the locations corresponding to a number of unknowns determined upon estimation 
of motion between the two images; 

converting the locations into a set of parameters based on the symmetry of 
tfie identified distinct features, the parameters reducing the number of unknowns 
as compared to a number of equations used to determme the unknowns; and 
estimating motion between the two images using the parameters by: 

providing an initial estimate of image rotation by estimation of each 
of the parameters, a first image pose transform corresponding to the first image, 
and a second image pose transform corresponding to the second image; 

multiplying each term of a set of terms used to determine the initial 
estimate by a weighted contribution factor based on the confidence of data 
corresponding to the initial estimate; 

adding an inequality constraint on a particular parameter of the 
parameters, such that the particular parameter is constrained within a 
predetermined minimum and maximum value; 

convertmg the inequality constraint to an equality constraint using a 

penalty function; and 

adding the equality constraint to the initial estimate. 
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40. (Previously presented) A computer-readable medium storing 
computer-executable instructions that, when executed on a computer, performs the 

method of claim 3 

41. (Canceled). 

42. (Canceled). 
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